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l | METHOD AND A DEVICE FOR OPERATING VOICE-CONTROLLED SYSTEMS 

IN MOTOR VEHICLES ] 

The present invention relates tcfa method and a device, according to the defin i t i on 
Ob of tho s pp ri r n i n C l n i rrr . 1 nnrl *v for operating voice-controlled systems, such as 
communication and/or one-way/two-way intercom devices in motor vehicles, where 
voice signals are picked up by a multiple microphone system and transmitted to at 
S least one loudspeaker. 

^ On the one hand, methods of this type are used in motor vehicles for voice- 
00 controlled intercom operation, but they are also used for supporting voice-input 
5 controlled electronic or electric modules. In this case, the fundamental problem is 
10 that, depending on the operating state, corresponding background noise is present 
M= in the motor vehicle. This background noise masks the voice commands. One- and 

two-way intercom systems in motor vehicles are pr o dom i nont ly advantageous in 
O large vehicles, minibusses, and the like. However, they can also be used in normal 
" passenger cars. Suppressing background noise or filtering out the voice command is 
1 5 still very important in the use of voice-controlled input units for electric components 

in the vehicle. 

0^ A l ong thebo li no c , a voice-recognition device for a motor vehicle is known from -EP 
^e^eOi^TB^t, where sensors signal or feed into the amplifier system of the voice- 
^ 20 recognition device, whether or not the engine is running and/or the vehicle is 

moving. This men guides a level control, by means-ef which it is attempted to isolate 
the voice command from the background noise. 

(VrHOA W. $14 sa9 Mi 

(1/ B E 3742920 €4 describes a s ot - up having two microphones, one of the 
25 microphones being disposed at the mouth of the operator, and another in proximity, 

which is, however, for picking up the structure-borne noise. Both microphone 
« signals are triggered -rrrsu ch mann or, that structure-borne noise can be subtracted 

from the total noise. 



tL3<>a -?ot93( 

NY01 316894 v1 



MODIFIED PAGE 



* 




im^ "?ui> l/s^ J fcf^ Af^)*cft>fbH At. /<?7t>5 Wid^cttb^ 

from BE 107 05 1 71 A1, it is known to support a voice-recognitiojijSystem^ using 
A transverse filtering. In this case, a frequency analysis i sGn^ortokon , which is only 
used for the purpose of recognizing speech commands. No ambient-noise 
compensation takes place here. 

A 

Filtering is ^known from -WO 97/34290,~whef£ periodic interference signals are 
filtered out by ascertaining their periods and canceling them out by interference, 
using a generator, so that the voice signal remains. 

t fe 4 1 06 405 C2 describes a method in which noise is subtracted from the voice 

A 

signal, a plurality of microphones being used. 

The use of a mumpfe microphone array is known from BE 30 25 580 A 1. When 
using jtln the motor vehicle, one of the microphones is disposed in the engine 
compartment and another in the passenger compartment. Both signals are then 
subtracted. A disadvantage in this case, is that only the engine noise,4r-^. the actual 
operational noise of the vehicle itself, is subtracted from the total signal in the 
oassenger compartment. Specific ambient noises are toft out of con s id e ration here . 
)ln Ifie same way, the lack of feedback suppression presents a special problem. 

A 

Wherever microphones and loudspeakers are arranged in acoustically coupleable 
proximity, the acoustic signal decoupled at the loudspeaker is fed back into the 
microphone^agetnrThis results in so-called feedback and a subsequent overload. 

A similar method is known from DE 39 25 589 A1 , where a composite signal made 
of a voice signal and an external signal is formed. The additional picking-up of 
external noise takes place separately. The external-noise ancf voice signals are lead 
over a filter and are subtracted from the composite signal. Then, the result of the 
comparison controls the filter. A method of this type cannot effectively prevent the 

Therefore; 
-method- 




inst abi l ity occurring in d sys t em o f mu l tip l e microphones an44e wj sp e a kftr^a re 
suppressed. 
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Thp ntritfjTl object of th Q pr^ gon * invftbtioi»4g-sinhiftvpri in a metnoa qt tne species, by 
— 4he-ehe raile i iz i ny featu r es - of Claim 1 - 

Ad sM uUyou uu fu ilh c r iL fin om o i ils uf I I l e method me bpecilled in C l dims -g-tfrfeagh 

5 

Regarding a device of the species, the stated object of the present invention is 
achieved by the characterizing features of Claims 5. Advantageous further 
refinements of the device according to the present invention are specified in the 
t§ remaining claims. 

With regard to both the method and the device, the present invention starts out from 
m ^ communication and/or one-way/two-way intercom device in ^ ot ^^^' es - 
(V, 4: this end, it is rIs^ kn^wfH**-** 5 ^^ multiple microphone system, to^ateejDick up 
M5 both \toice and noise cigngig * ^ p h to snhtcart th n nnh e signals aga in from the total 
signal, so that the filtered voice signal remains. 

a □ /Nn c n rriing t o th n tt n tori oh j nr t , tho r^sonco of th Q present invention eewsists in 

~ initially shifting the frequency of the specific microphone signal by a small amount A 
20 F, and only then transmitting the microphone signal to the loudspeaker(s) or to the 
input of a voice-controlled device. The frequency shift of the present invention, 
(j^ which is^wertaken at a defined position and is not arbitrary, supports the filtering 

on the one hand, and decouples feedback, and therefore the echo signal, on the 
'^V^^'^^^ther hand^by subtracting the composite signal shifted by A F, of another, i.e. 
25 second, microphone, from the composite signal of a first microphone, whose 
frequency is not yet shifted; and vice versa. 

Since, without the aforesaid frequency shift of the present invention, feedback is 
nothing more than the fed-back, amplified voice signal, such feedback cannot be 
30 eliminated by roea«e*and procedures from the cited related art. This is therefore the 
fry case, because aevices of the rolatod art-only separate the voice signal from the 
noise signal, and identify the fed-back signal as a voice signal, and not as a noise 
signal. For this reason, the aforesaid instances of feedback cannot be controlled by 
the meaffl; Known in thn minted nrt, or cannot be controlled simultaneously. 
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In contrast, the method and the device of the present invention, the latter of which 
relates to the connection of the individual elements to one another, eliminate 
feedback effects in a«-elegaot manner^ 



5 Since feedback, ae-etteh, always occurs when the microphone and loudspeaker 

locations are close together, as c tsxampafe^ in motor vehicles, the elimination of 
k' this feedback is very important h rtho mont i onod app li cat i on cas e. This is not only 
valid in the case of intercom operation, where electroacoustical feedback is 
uncomfortable for the passengers, but it also has special significance in the use of 
H ip voice-controlled input interfaces of electrical or electronic components on the 
5 vehicle. This only applies when the entire system in the vehicle includes both 
Sj microphones and loudspeakers, and in this case, also when the input to electrical 
J devices is voice-controlled. Feedback and resulting overloads can cause 
W considerable malfunctions and misinterpretations of the voice command, even in the 
^ Js case of intelligent input interfaces. Depending on the application -Gas^, this also 

{7 constitutes a safety hazard. As an option, noise reduction can also be implemented 
l^Q at the same time, 4^-e^simultaneously. 

m a 

u The present invention is represented in the drawing, and subsequently described in 
20 detail. 



25 



The-fig u ro chows tho pr i nc i pa hj e^ l gn, ds we ll a3 the funct i on i ng mothod, -so-that 
both the method ct o ps a nd th e connoction of the i nd i vidua l ele men t s of the p r es ent 

i nvontion to P£^h ntiyaj: ran hp coon in th^ir Ingiral entirety , frnm thft figure i te ftlf 

tn thts- d i op l oy ed exemplary embodiment of the present invention, the vehicle interior 
is subdivided into two subspaces, namely front and rear. 

A microphone M 1 and a loudspeaker L 2 are located in the front section. 
30 Microphone M 1 picks up the voice signal thefe, and possibly picks up noise signals 
as well. In this case, the noise signal is made up of the background noise in the 
passenger compartment, which occurs while operating the vehicle. This ca n be ^ 
engine noises, wind noises, a e w ell qg rolling noises, but also acoustical echo 
signals from the other subspace, and the like. The composite signal (total signal) 
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eorrtatned at M 1 , which is-made-t^of background speech and background noise, is 
fed to a first summation point S 1 . Then, a correspondingly conditioned signal from 
an acoustic model AM 1 in front is also fed to this summation point. In this 
exemplary embodiment, the subtraction signal generated in acoustic model AM 1 
originates from the signal, which is obtained in the rear section of the vehicle, and is 
already shifted in frequency. Because this signal, which comes from M 2, is 
frequency-shifted in F2, and originates from the rear subspace of the passenger 
compartment, is also taken into account in front on a signal basis, by AM 1 , the 
signal, which is generated in the rear subspace of the vehicle, is acoustically 
transported up front, into the front subspace of the passenger compartment^^ 
also registered by M 1 , is subtracted again at summation point S 1 . This me a n s th at 
the rear subspace of the passenger compartment is acoustically separated from the 
front subspace of the passenger compartment by device AM 1 . That is, the total 
detectable acoustical signal is initially fed into M 1 , and the echo from the rear 
subspace of the passenger compartment is initially subtracted at summation point S 
1 . The original signal from the front subspace of the passenger compartment, which 
is obtained from M 1 in this manner, is then supplied to a frequency-shifting device F 

1 , and shifted by an amount A F, e.g. 5 Hz. The F 1 output signal obtained in this 
manner is then supplied to loudspeaker L 1 of the rear passenger-compartment 
subspace and, on the other hand, is simultaneously fed into device AM 2 in the 
same manner. In this case, AM 2 again represents the acoustic model for the rear 
subspace of the passenger compartment. A voice message is transmitted in an 
analogous manner from the rear subspace of the passenger compartment, via M2, 
to the front subspace of the passenger compartment, via L 2. That is, microphone M 
2 registers the voice message together with the background noise in the rear 
subspace of the passenger compartment, and transmits them to summation point S 

2, at which the total acoustical signal picked up by M1 , i.e. the echo as well as 
ambient noises, is subtracted. In turn, the echo-free signal from microphone M 2, 
which is generated in this manner, is then supplied to a frequency-shifting device F 
2, as well, which again shifts the frequency by an amount A F. At the output of this 
frequency-shifting device F 2, the result, i.e^Jhe signal conditioned in this manner, is 
again supplied to the front subspace of the passenger compartment, namely to 
loudspeaker L 2 positioned there. The frequency shift for the transmission from the 
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front to the rear can also be different from the frequency shift from the rear to the 
front. 

All in all, the result is a closed, feedback-free system. The shifting of the frequency is 
an important feature here, and the echo from the front to the rear subspace, and 
vice versa, is eliminated by the interaction with the connection via acoustic models 
AM 1 and AM 2. 

However, it is also possible to add a noise-signal subtraction to the echo 
suppression and feedback elimination. This can also be appropriately taken into 
consideration in the specific acoustic model AM 1 and AM 2. The additional 
components necessary for this purpose, such as noise-signal microphones, are not 
shown here in further detail. 

Therefore, i t - cQn± > p ca i d tha Ube-total ba ckg ro und-no i s e siyud l ma r U e up uf fcfClKrami 
oth er no i oeqH o o ubtract od from every acoustical input signal from M 1 and M 2, 
before it is processed further and fed to loudspeakers L 2 and L 1 , respectively. So 
not only does an acoustic decoupling tako p l a ce between the front and rear 
subspaces of the passenger compartment, but also the remaining noise signals are 
quasi compensated for, or subtracted, in ono a nd the same aetien step. 
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